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Abstract — This paper considers a degraded Gaussian broadcast 
channel over which Gaussian sources are to be communicated. 
When the sources are independent, this paper shows that hybrid 
coding achieves the optimal distortion region, the same as that of 
separate source and channel coding. It also shows that uncoded 
transmission is not optimal for this setting. For correlated 
sources, the paper shows that a hybrid coding strategy has 
a better distortion region than separate source-channel coding 
below a certain signal to noise ratio threshold. Thus, hybrid 
coding is a good choice for Gaussian broadcast channels with 
correlated Gaussian sourcesQ 

I. Introduction 

The transmission of sources over a Gaussian broadcast 
channel [IJ is a fundamental problem in information theory 
and arguably one of the better understood questions. In the 
case of independent sources over this degraded channel, the 
capacity region is characterized in Q, The achievable 
strategy for this channel in (|2| is superposition coding, but 
dirty paper coding pj can also be used to the same effect. 

In contrast, the existing body of work on correlated sources 
over a broadcast channel is somewhat limited IS]. As source- 
channel separation does not hold, it is difficult to construct 
coding strategies and establish their optimality. Recently in |6], 
uncoded transmission of correlated Gaussians over a Gaussian 
broadcast channel was shown to be optimal below a signal to 
noise ratio (SNR) threshold . In related work, the transmission 
of a common source over a Gaussian broadcast channel with 
receiver side information was studied in fTl. 

In this work, we consider hybrid coding as a strategy for the 
Gaussian broadcast channel with or without correlated sources. 
By hybrid coding, we mean strategies that superimpose un- 
coded and coded transmission in communicating the sources 
to the destinations. Our hybrid coding strategy bears close 
resemblance to the dirty-paper-coding strategy using lattices, 
as developed in |8J. We show that this hybrid strategy is 
optimal for the Gaussian broadcast channel with independent 
Gaussian sources. Extending it to the correlated case, we find 
that the strategy performs better (in terms of the distortion 
region achieved) than separate source and channel coding for 
SNRs below a certain threshold. 

' This work is supported by a grant from AT&T Labs Austin, a grant from 
the Army Research Office and a grant from the Air Force Office of Sponsored 
Research. 



In the next section, we present the system model. In Section 
Uni we present an outer bound on the distortion region for this 
channel. We present the achievable scheme and the resulting 
distortion region for this channel in Section |IV] and conclude 
with Section [V] 

II. System Model 
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Fig. L System Model 

The system model is depicted in Fig. 1. Consider a se- 
quence of independent and identically distributed (i.i.d) pair 
of correlated Gaussians {(S'i(i), S'2(i))}"^i with mean zero 
and covariance matrix, 
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pa- 

„2 



The goal is to transmit the pair over a degraded Gaussian 
broadcast channel to Receivers 1 and 2 respectively at the 
smallest possible distortion. We assume, with loss of gener- 
ality, that (0 > and that the variances of 5*1(1) and 5*2 («) 
are equal. The transmitter applies an encoding function on the 
observed source sequence and transmits it over the channel. 
Mathematically, 

x" = /(5r,52") 

where 5" and 6*2 denote n-length vectors. The transmitter 
is limited by an average second moment constraint on the 
channel input given by 



1 " 



The channel outputs at the two receivers are given by 



Yli^) 



X{i) + Zi{i) 



for i = where Zi{i) and («) form an i.i.d 

sequence, independent of each other and are Gaussian dis- 
tributed with mean zero and variance iVi and Further, we 
assume that the broadcast channel is physically degraded with 
N2 > Ni. The receivers obtain estimates of the sources by 
applying a function on the received outputs. This is represented 
mathematically as 

for k = 1,2. The goal is to obtain estimates 5" and S2 within 
the minimum possible mean squared error Therefore, we wish 
to obtain the smallest possible Di and D2 where 



1 

n ^-^ 

i=l 



for = 1,2. The distortion region 'D{a^ , p, P, Ni, N2) is 
defined as the set of all pairs {Di,D2) such that there exist 
encoding and decoding functions /, (pi and 02 resulting in 
distortions Di and D2 at Receivers 1 and 2 respectively. Note 
that all logarithms are with respect to base 2 throughout the 
paper and E denotes the expected value of a random variable. 

III. Outer Bound on Distortion Region 

We now present an outer bound on the conditional distortion 
region for the transmission of correlated Gaussian sources 
over a degraded broadcast channel. Let (/)x|2 be the decoding 
function given the knowledge of both Yj" and S2 at Receiver 
1. The conditional distortion region Vdcr^ , p, P, Ni, N2), 
is defined as the set of all pairs (-Di|2,^2) such that there 
exist encoding function / and decoding functions 0i|2 and 
(j)2 resulting in distortions and D2 at Receivers 1 and 2 
respectively. The region described by Theorem 1 below is an 
alternative way of describing the outer bound region for the 
same channel presented in jS). 

Theorem 1: The conditional distortion region for transmis- 
sion of correlated Gaussian sources over a degraded broadcast 
channel, Vdo-^, p, P, Ni, N2), consists of all pairs {0^2, D2) 
such that 



D112 > 



a\l-p^) 



1 



and D9 > 



(l-ai)P 

QlP+Af2 



1 



where ai £ [0, 1]. 

Proof: We first obtain a bound on the distortion I?i|2- By 
the data processing inequaUty (DPI), we have 



I{Sl^;S^\S^)<I{S{^;Yr\S^) 



(1) 



by definition of the rate distortion function for Gaussian 
sources |j9l- Now, 

/(5r;yi"|52") = HYi^ls^) - hiYi^is^^s^) 

= -\og2TTe{aiP + Ni)-h{Z^) (3) 

Tl Ti 

= -log27re(aiP + iVi) - -log27reiVi 



n , „ aiP 



(4) 



The equality in results from the following argument. Since 

77 7? 

-log2^eiVi < hiVriS^) < -log2^e(F + 7Vi), 
there exists an ai E [0, 1] such that 



h{Yr\S'2') = - \og2TTeiaiP + Ni). 
Therefore, from (|2|i and dU, we get 

J-l^ — 1 I aiP 



For source 6*2 , using DPI we observe that 
I{S^;S^)<I{S;^;Y^). 

The rate distortion function for S2 implies that 

9 

Tl (7 

-log—<IiS^;S^). 

Also, 

I{S^;Y2n = hiY2n~hiY2-\S'S) 

Tl 

< -log2ne{P + N2) - hiYnS'2') 
n 



(5) 



(6) 



(7) 



(8) 



< -log27re(P + 7V2)- ^log27re(aiP + 7V2) 

(9) 

(10) 



71, / (l-ai)P' 



since in (O, a Gaussian random variable maximizes entropy 
for a given variance and ^ is true due to the following 
discussion. Note that due to the physically degraded nature of 
the broadcast channel, Y2 may be written as Y2 = Y{^ + 
where W has variance N2 — Ni. Thus using ^ and entropy 
power inequality, we get 

h{Y2^\S'2') ^ HY^ + ^13^) 

Tl 

> - log 27re(aiP + Ni + N2 - Ni) 

Tl 

= -\og2TTe{aiP + N2). 



The distortion in S*;* at Receiver 1 given that it knows 5^' and Combining ^, (□) and we obtain 
Y" is _Di|2 and the variance of S*" given 5^ is cr^(l — p^). 



Since S2 is known at both the transmitter and Receiver 1, 

^ J^l\2 



D2 > 



(2) 



1 , {l-ai)P 



Note that the outer bound on the conditional distortion 
region is obtained as a function of ai. We now state a corollary 
for the case of independent sources. 

Corollary 1: The distortion region for transmission of inde- 
pendent Gaussian sources over a degraded broadcast channel, 
r>(cr^,0,P, 7Vi,iV2), consists of all pairs (L»i,D2) such that 



1 



aiP 



and Do > 



1 + 



(l-ai)P 



aiP+N2 

where qi e [0, 1]. 

Proof: We only present the proof for Di since the result 
for D2 is the same as in the theorem above. Note that 



^h{S^\S^)~hiS{'\Sl,\S^) 
^h{S'l)-hiS'^\S^,S'^) (11) 
> KS^) - h{S^\S[') (12) 



(13) 



where (fTTT i uses the independence of S*" and S2, (fT2l i is true 
because conditioning reduces entropy and ( fOl l follows from 
the rate distortion function for Gaussian sources. 
Now combining the above with ([T]i and (|4]i, we get 



aiP 
AT, 



IV. Achievable Distortion Region 

In this section, we present achievable distortion regions for 
transmitting independent and correlated Gaussian sources. We 
briefly discuss aspects of the coding scheme that are common 
for both the independent and correlated cases. The hybrid 
schemes proposed in the following subsections are based on 
lattices. Let A be a lattice of dimension n. Let the quantized 
value of a; € M", Q{x) ~ argmin^g;^||.T— r||. The fundamental 
Voronoi region of A is defined as Vo ~ {x G R" : Q{x) ^ 0}. 
Also, we denote xmodA ~ x — Q{x). We choose A to 
be a 'good' lattice for both source and channel coding ifTOl 
and require it to have a second moment constraint cr^(A) = 



Vo 



^ dx 



P' where P' will be specified later Note that the 



transmitter has an average power constraint P. 
A. Independent Gaussian Sources 

We now compare a hybrid coding strategy with 
uncoded transmission for communicating independent 
Gaussian sources. A hybrid coding scheme is basically 
a superposition of coded and uncoded transmission. 
Let the distortion region achieved by the hybrid 
scheme be ^^(ct^, 0, P, A^i, A^j) = {{Di.D^) : 
Di and D2 are achieved by the hybrid scheme}. 

Theorem 2: Vhi(T^,0, P, A^i, A^a) = ^?(c^^ 0, P, A^i, A^a) 
Proof: Consider a hybrid coding scheme in which the 
coded portion is given by 



where /? and 7 are constants which will be specified later 
and [/" is the dither which is known apriori to both the 
transmitter and receivers and is uniformly distributed in Vq. 
We send 5^ uncoded after scaling it appropriately to meet the 
power constraint. In the following, ai represents the power 
allocation in the outer bound discussion. The channel input 
is a superposition of coded and uncoded transmission and is 
expressed as 



where a satisfies 



and 
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^P' aiP 



(l-ai)P 



(14) 



(15) 



Note that X" and S2 are independent of each other on account 
of addition of the uniform dither before the modulo operation. 
We also observe that the scheme is similar to the dirty paper 
coding strategy in fS) where 5*2 resembles the interference 
known at the transmitter. The output at the receivers is given 
by 

(16) 



=X" + ZJ^ 



for A: = 1,2. 



At Receiver 1, we perform the following series of operations: 

P'l' =[(5Yi" - C/"]modA (17) 
^[{Sa - 1)X^ + S[' + {(3j + S-f)S^ + SZ['] mod A 

(18) 

= [5"]" + 7((5 + (3)S^ + {Sa - 1)X^ + 6Z^] mod A (19) 
= [S'i" + M^i"]modA (20) 

where W^' = 7((5 + /3)S'^' + {5a ~ 1)X[' + 5Z[' is the effective 
noise term independent of S*". Choosing (3 — —5 and S = 
— j-Stttu-, we reduce the variance of the effective noise to 
■^^rpr^^- Since A is a 'good' channel lattice, we require P' 
to satisfy 

<P', (21) 
a^P' + Ni - ' ^ ^ 

for correct decoding with high probability as n cx) limifT2ll . 
This leads to 

R'^ = [ST + Wl'] mod A = Si" + W^. 

Allowing P' to satisfy (ISTT i with equality and using ( fT4l i. we 
obtain 

2aiP + Ni 

P = a and a = 

aiP 



aiP 



Thus W\ has variance 



aiP 



P' 

The estimator 



OL\P 



Hi , 



achieves a distortion in Si of 



On the other hand. Receiver 2 observes 



B. Correlated Gaussian Sources 



where W2 = aX^ + Z2 is treated as the effective noise which 
is independent of S'2 ■ We now construct the linear estimator 



5? 



7(7 



Using ( fT5] l. this estimator results in a distortion 

^2 



i?2 = 



1 



aiP+Af2 



Thus the superposition scheme described above achieves the 
optimal distortions for sources Si and ^2. ■ 
We now show that uncoded transmission is sub-optimal 
for independent sources through the following theorem. Let 
the distortion region achieved by uncoded transmission be 
I?„(a2,0,P,iVi,7V2). 

Theorem 3: 2?„ is equal to the set of all distortion pairs 
(Di, L»2) such that 



1 



and D2 > 



1 



(l-ai)P 
aiP+N2 



{l-ai)P+Ni 

where ai £ [0, 1]. Further, 

Vu {a^ , 0, P, iVi , A^a) C V{a^ , 0, P, iVi , TVa) ■ 

Proof: The uncoded transmission strategy is to send a 
linear combination of 5" and S'2 . The power allocated for 
sending S" and S'2 are aiP and (1 — ai)P respectively. 
Therefore we transmit. 



X" = 



2~ 1 



(l-ai)P 



S2". 



Receiver 1 obtains a minimum mean squared error (MMSE) 
estimate of Sf given ¥{" as Sf = ^p^^f >?■ This leads to 
a distortion in Si, 



D, = 



aiP 



(l-Ql)P + Afl 



The estimate of SJ is given by Sj = ^p^j^^ — ^2" resulting 



m 



i?2 



(T 



(l-ai)P 



1 



aiP+Af2 



We observe that while uncoded transmission scheme achieves 
the optimal distortion in S2, the distortion in Si is higher 
than the optimal distortion. Thus Vu{cr'^ ,0, P, Ni, N2) C 
V{a\0,P,Ni,N2). m 



Next, we extend our hybrid coding scheme to the problem 
of correlated sources, with the goal of achieving a better 
distortion region than source channel separation. We consider 
two source channel separation schemes in this section. Scheme 
A and Scheme B. Scheme A treats the messages obtained 
by compressing Si and S2 as independent and communicates 
them reliably over the broadcast channel. Scheme B explores 
the idea of using Wyner Ziv coding for communicating Si. 
Let the distortion region achieved by the hybrid scheme 
be 'Dh{(j'^ , p, P, Ni, N2) and the distortion region achieved 
by Scheme A and Scheme B be VAia^ , p, P, Ni, N2) and 
pB(a2,p,P,7Vi,iV2). 

Theorem 4: If ai < i and < ' , then 

^ Z iVl 

Va{,cj'',p, P, Ni,N2) C Vhia^p, P, iVi, 7V2). 

For any > and < ai < 1, 

Vsi^y^P, P, iVi, 7V2) C Vh{a^,p, P, iVi, 7V2). 

Proof: We begin by noting that S" may be represented 
as S" = pS2 + V" with independent of Sj and Gaussian 
distributed with mean zero and variance cr^(l — p^). The 
main idea of the hybrid coding scheme is to use the scheme 
proposed in the previous subsection to send and S2 , which 
are independent. Thus, the transmitter forms the coded portion 
of the channel input similar to the independent case using the 
lattice A as 

X^ = [y" + /37SJ + [/"] mod A. 

As before, S2 is sent uncoded and superposed on the coded 
portion after an appropriate scaling to satisfy the power 
constraint. Thus the channel input is given by 

X" = aXr + 7S^\ 

where a and 7 satisfy (fT4l i and (flSl l respectively. 



The channel output at Receiver 1 is expressed as 

= aX^ + -fS!^ + Z'^. 



(22) 



The receiver can now perform the same sequence of operations 
as in Equations (fT7]i-(l20li to obtain 

Kn = [y" + M^ri]modA 

where W^^ = -/{S + (3)S^ + {5a - l)X1 + SZ'l represents 
the effective noise indepen dent of F". By choosing P' = 

,2(1 _ p^Y^, a ^^,6= ^ and /? = -S, 
we get 



(23) 



where the variance of Wn is given by " ''^^p ■ Observe 
that we can rewrite ( |22] ) as a noisy observation of S2 in the 
form 

i??^2 = ^2 + ^^12 (24) 



where = ''"'^^ is independent of S2 and has 



vanance 



{aiP+Ni)cr^ 
(l-ai)P 



Now, using the noisy observations of V" and S2 in 
(l23T l and ( |24] | respectively, we construct a hnear estimator 
of Si given i?"]^ and i?"2- Before finding the estimator, we 
observe that and W12 are uncorrected for the choice of 
constants a and 6 stated above. For each time instant i, 

7 

1 



7 



((5a - l)aP' + SNi) = 



since 5 



a^P'+jVi • Therefore i?"^ and R12 are uncorrelated 
as well and the linear estimator of 5" is given by 



ST = 



1 



1 



QiP 



1 



QiP-K/Vi"^12- 



+ (l-ai)P 



The distortion resulting in 5i is calculated to be 



1 



QlP 

TV, 



1 



(l-ai)P 
aiP+JVi 



Receiver 2 obtains the estimate of 5*2 in the same fashion 
as the independent case by treating the coded portion of the 
received signal as noise to obtain a distortion 



1 



Thus 



Vh = <^ {Di,D2):Di > 



D2 > 



(l-ai)P ' 
aiP+Af2 



^ 

(l-ai)P 

QlP+A''2 



1 I 

' aiP+iVi 



We now compare the distortion region achieved by the hybrid 
coding scheme with two possible source channel separation 
schemes. Scheme A and Scheme B. In Scheme A, 5" and 
S2 are compressed to obtain messages that can be reliably 
transmitted over the broadcast channel. The distortion region 
achieved by this scheme is given by the set 



Va = I iDi,D2) : Di > 



1 + ^ 



1 I {l-ai)P 
^ ^ QiP+Ar2 



< 



The distortion in Si incurred by the hybrid scheme is smaller 
than the distortion that is achieved by the above source channel 
separation scheme if 

1 , oiP ^ -, (l-ai)P 1 I 

Ni -L + ai P+Ni ^ ^ Wi 

P 1 - 2ai 
Thus Va C Vh for ai < i and ^ < 



In Scheme B, we use the representation S"" = pS2 + V", 
stated earlier in this section. The transmitter compresses 1/" 
and 5*2 to obtain messages that can be reliably communicated 
to Receivers 1 and 2 respectively. Due to the degraded nature 
of the broadcast channel. Receiver 1 can mimic Receiver 2 
to obtain an estimate of 5*2 . Now Receiver 1, combines the 
estimates of 5*2 and V" to construct an estimate of S". The 
distortion region thus achieved is given by 



Vb = <^ iDi,D2) : Di > 



1 I QlP + -, (l-ai)P ' 
^2 ~1 



Do > 



(l-ai)P 



aiP+N2 



Hence, Vb C X>/i for ^ > and < ai < 1. 



V. Conclusions 

We present a hybrid coding scheme for source channel 
communication of correlated Gaussian sources over broadcast 
channels, that resembles dirty paper coding. We show that 
the scheme is optimal in terms of achieving the smallest 
distortion for communicating independent sources. Further, we 
prove that for a non-trivial set of SNR, the scheme achieves 
a lower distortion than source channel separation. As a next 
step, we plan to compare uncoded, hybrid coded and separately 
coded transmission schemes to determine regimes where each 
outperforms the others. 
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